Analysis of a micro–macro acceleration method with minimum relative entropy moment matching
نویسندگان
چکیده
منابع مشابه
Spectral moment matching in the maximum entropy spectral analysis method
The formula for the spectral moments is expanded in a series consisting of autocorrelation terms. By using the autocorrelation extrapolation inherent in the maximum entropy method (MEM) for spectral analysis, it is found that good estimates of the moments can be found from a very low order autoregressive model. The motivation for this investigation came from results obtained during spectral ana...
متن کاملA minimum relative entropy principle for AGI
In this paper the principle of minimum relative entropy (PMRE) is proposed as a fundamental principle and idea that can be used in the field of AGI. It is shown to have a very strong mathematical foundation, that it is even more fundamental then Bayes rule or MaxEnt alone and that it can be related to neuroscience. Hierarchical structures, hierarchies in timescales and learning and generating s...
متن کاملMinimum relative entropy distributions with a large mean are Gaussian.
Entropy optimization principles are versatile tools with wide-ranging applications from statistical physics to engineering to ecology. Here we consider the following constrained problem: Given a prior probability distribution q, find the posterior distribution p minimizing the relative entropy (also known as the Kullback-Leibler divergence) with respect to q under the constraint that mean(p) is...
متن کاملA MATLAB Implementation of the Minimum Relative Entropy Method for Linear Inverse Problems
The minimum relative entropy (MRE) method can be used to solve linear inverse problems of the form Gm = d, where m is a vector of unknown model parameters and d is a vector of measured data. The MRE method treats the elements of m as random variables, and obtains a multivariate probability density function for m. The probability density function is constrained by prior information about the upp...
متن کاملA regularized discriminative training method of acoustic models derived by minimum relative entropy discrimination
We present a realization method of the principle of minimum relative entropy discrimination (MRED) in order to derive a regularized discriminative training method. MRED is advantageous since it provides a Bayesian interpretations of the conventional discriminative training methods and regularization techniques. In order to realize MRED for speech recognition, we proposed an approximation method...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Stochastic Processes and their Applications
سال: 2020
ISSN: 0304-4149
DOI: 10.1016/j.spa.2019.10.008